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13. The image processing method according to claim 1 , 
wherein: 



said image processing method is a method of 
enlarging an image composed of a plurality of s 
picture elements by inserting interpolated pic- 
ture elements respectively between the picture 
elements, 

the target picture element of which the density 
computed in said computing step is the interpo- 10 "' 
lated picture element. 



14. The image processing method according to claim * 
13. further comprising the step of reading a docu- . : 
ment image and converting the read image into is 
image data so as to input the image data into said 
region segmentation means before said detecting 
step. 

1 5. An image processing apparatus for scaling inputted 20 
image so as to output the magnification varied * ■ 
image, comprising: 

region segmentation means for dividing the 
input image into blocks composed of a plurality 25 

of picture elements and-detecting region seg- \- 

mentation data, which represent possibilities of 
characters, photographs and mesh dots of a 
block of a target picture element per target pic- 
ture element; and 30 . 
computing means for computing density of the 
target picture element on the output image by 
using an equation in which density of a plurality 
of adjacent picture elements in the vicinity of 
the target picture element is inputted, 35 . 

wherein said computing means adjusts 
a weight of the density of each adjacent picture ' ' 
element in the equation according to the region 
segmentation data of the target picture ele- 
ment. 40 



45 



50 
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in said computing step, density D p of a picture 
element P which is a target picture element 
whose density should be determined, is com- 
puted according to the following equation: 

5 

D p = (1-K)xD a + KxD b (1) 

(However, 
K = (X p /(N-1 )) x (PA/(PA+PB)) ) 
where Xp is region segmentation data of the 10 
picture element P t D a is density of a picture ele- 
ment A which is the closest to the picture ele- 
ment P, D b is density of a picture element B 
which is the second closest to the picture-ele- 
ment P. PA is a distance between the picture is 
element P and the picture element A. and PB is 
a distance between the picture element P and 
the picture element B. 

5. The image processing method according to claim 4, 20 . 
further comprising the steps of: 

obtaining picture element density slope data 
which represent density slope of the picture 
element P with respect to picture elements 25 
which are adjacent to the picture element P 

. aft er-sad computing-step; and - -- 

on the picture element P whose region seg- 
mentation data X p is 0 and whose density D p is 
half tone density, and on the picture element A . 30 
which is the closest to the picture element P, 
when the picture element density slope data 
are data representing a relationship D a < D p < 
Djj. converting the density D p into a value 
obtained by multiplying the half-tone density 35 
and magnification of the various scaling 
together and setting the density D a to 0, 
whereas when the picture element density 
slope data are data representing a relationship 
D b < Dp < D a , converting the density D a into a 40 
value obtained by multiplying the harf-tone den- 
sity and magnification together and setting the 
density D p to 0. 

6. The image processing method according to claim 5, 45 
f urth er comprising : 

the step of outputting a laser according to den- 
sity data with respect to the picture element P 
after said converting step, so 

wherein in said laser outputting step, a 
laser is outputted to the picture element P, to 
which the value obtained by multiplying the 
half-tone density and the magnification 
together is given, in a position which is shifted 55 
to a side of the picture element where the den- 
sity is higher based upon the picture element 
density slope data of the picture element P. 



7. The image processing method according to claim 1 , 
wherein in said computing step, when the data of 
each target picture element is computed by said 
computing means, magnification of the region seg- 
mentation data detected by said region segmenta- 
tion means is scaled so as to be outputted together 
with the scaled image data. 

8. The image processing method according to claim 7, 
wherein the variable magnification process for the 
region segmentation data in said computing step is 
performed by using the nearest neighbor interpola- 
tion. 

9. The image processing method according to claim 7, 
wherein the variable magnification process for the 
region segmentation data in said computing step is 
performed based upon the result detected by said 
region segmentation means. 

10. ' The image processing method according to claim 7, 

further comprising: 

the step of simultaneously outputting the 
scaled image data and the scaled region seg- 
mentation data after the computing step, 

wherein in said outputting step. directing - 

data, which represent a front and a rear of each 
iine of plural picture elements on the output 
data and end of the image data, together with 
the scaled image data and the scaled region 
segmentation data. 

1 1 . The image processing method according to claim 1 , 
further comprising: 

the step of obtaining picture element density 
slope data which represent density slope of the 
target picture element with respect to picture 
elements which are adjacent to the target pic- 
ture element after said computing step; and 
the step of outputting a laser according to the 
density data of each picture element, 

wherein in said laser outputting step, a 
laser is outputted to the target picture element, 
to which the value obtained by multiplying the 
half-tone density and the magnification of the 
various scaling together is given, in a position 
which is shifted to a side of the picture element 
where the density is higher based upon the pic- 
ture element density slope data of the target 
picture element. 

12. The image processing method according to claim 1, 
further comprising the step of reading, a document 
image and converting the read image into image 
data so as to input the image data into said region 
segmentation means before said detecting step. 
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not subject to the variable scaling process, a number of 
picture elements does not agree with the scaling -proc- 
essed image data 4a. Therefore, there arises a problem 
that the region segmentation data 3b cannot be used. 

However, in the above method, also the region seg- 
mentation data 3b detected by the region segmentation 
section 3 are subject to the variable scaling process 
based upon the result detected by the region segmenta- 
tion section 3 so as to be outputted as the scaling-proc- 

essed region segmentation data 4b together with the 

scaling-processed image data 4a. 

Therefore, since a number of picture elements of 
magnification varied image data agrees with that of 
region segmentation data, even if these data are output- 
ted to an external asynchronous image input/output 
device such as a facsimile and a personal computer, 
region segmentation data can be used. 

In addition, since the possibilities of characters, 
photographs and mesh dots are given also to the scal- 
ing-processed region segmentation data 4b, they are 
combined together so that the scaling-processed image 
can be outputted to the asynchronizer 10. 

In addition, in the case where the scaling-proc- 
essed image data 4a and the scaling-processed region 
segmentation data 4b are simultaneously outputted, the 
image processing method of the present embodiment 
simultaneously outputs the direction data 20, 21 and 22, 
which represent the front and rear of each line of plural 
picture elements on output data, and the end of image 
data. 

In other words, in the case where the scaling-proc- 
essed image data 4a are outputted to the asynchronizer 
10 such as a facsimile and a personal computer, when 
the directing data, which represent the front and rear of 
the lines and the end of the image data, do not exist in 
the scaling-processed region segmentation data 4b, a 
number of picture elements for one line and a total 
number of lines should be transmitted to an external 
asynchronizer 10. Furthermore, even if the above num- 
bers are transmitted to the synchronizer 10, a line coun- 
ter should be always provided. 

However, in accordance with the above method, 
since the directing data 20. 21 and 22, which represent 
the front and rear of each line of plural picture elements 
on the output data and the end of the image data, are 
simultaneously outputted, a number of picture elements 
of one line and a total number of lines do not have to be 
transmitted to an external asynchronizer 10, thereby 
making it possible to avoid installation of the line coun- 
ter. 

In the present embodiment, the nearest neighbor 

~ : — - interpolation is used for the variable scaling process of 

the region segmentation data 3b, but the method is not 
limited to this, and thus the scaling process can be per- 
formed based upon the region segmentation data 3b 
like scaling of image data. 

The invention being thus described, it will be obvi- 
ous that the same may be varied in many ways. Such 
variations are not to be regarded as a departure from 



the spirit and scope of the invention, and all such modi- 
fications as would be obvious to one skilled in the art 
are intended to be included within the scope of the fol- 
lowing claims. 

5 

Claims 

1. An image processing method for scaling an image, 
comprising the steps of: 

10 " 

dividing an image into blocks composed of a 
plurality of picture elements so as to detect 
region segmentation data, which represent 
possibilities of characters, photographs and 

is mesh , dots in a block of a target picture ele- 

ment, by region segmentation means per tar- 
get picture element; and 
computing density of the target picture element 
on the output image by using computing means 

20 according to an equation into which density of a 

plurality of adjacent picture elements in the 
vicinity of the target picture element are input- 
ted, 

wherein in said computing step, a weight 
25 of the density of each adjacent picture element . 

in the equation is adjusted according- to the 
region segmentation data of the target picture 
element. 

30 2. The image processing method according to claim 1 , 
wherein in said computing step, the weight of the 
density of each adjacent picture element in the 
equation is adjusted so as to fall within a range of a 
weight obtained by the nearest neighbor interpola- 

35 tion to weights obtained by the interpolations of first 
through third degrees. 

3. The image processing method according to claim 1 , 
wherein in said computing step, as the possibility of 

40 characters represented by the region segmentation 
data is stronger, a weight of density of an adjacent 
picture elements which is the closest to the target 
picture element in the equation is set larger, and as 
the possibilities of photographs and mesh dots rep- 

45 resented in the region segmentation data are 
stronger, the weight is set smaller. 

4. The image processing method according to claim 1 , 
wherein: 

so 

in said detecting step, the region segmentation 
. data are set so as to take a value X which falls 
within the range of 0 to N-1 (N is an integral 
number hot less than 2) and so that as the pos- 
55 sibility of characters is stronger, the region seg- 

mentation data takes a smaller value and as 
the possibilities of photographs and mesh dots 
are stronger, the region segmentation data 
takes a larger value, 
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data 3a and region segmentation data 3b. 

The variable scaling section 4 performs scaling 
process on the inputted image data 3a and the region 
segmentation data 3b, and refers to picture elements in 
the vicinity of the target picture element so as to deter- 5 
mine density slope of the target picture element. Then, 
the variable scaling section 4 outputs scaling -processed 
image data 4a, scaling-processed region segmentation 
data 4b and special data 4c. 

At the time of the above variable scaling process, 10 
the equation (1) is used for the image data 3a, and the 
nearest neighbor interpolation is used for the region 
segmentation data 3b. Moreover, the special data 4c 
are composed of directing data, which show the front 
and rear of the line of the region segmentation data 3b is 
and the end of the image data, and picture element den- 
sity slope data S with respect to a picture element which 
is currently subject to the process. Further, when the 
region segmentation data 3b are other than data which 
represent strong possibility of characters, the picture 20 
element density slope data S are outputted as "no 
slope". 

These outputs are outputted to the second image 
processing section 1 5. Then, they are transmitted to the 
asynchronizer 10 such as a facsimile and a personal 25 
computer, which is additionally provided, by a method, 
mentioned later. 

On the contrary, an image which is scaled by 
another digital copying machine is received by and 
inputted to the second image processing section 15 via 30 
the asynchronizer 10 such as facsimile. 

The scaling-processed image data 4a inputted into 
the second image processing section 15, the scaling- 
processed region segmentation data 4b and the special 
data 4c or the received and inputted variable magrdfica- 35 
tion processed image are outputted as scaling-proc- 
essed y corrected image data 15a, scaling-processed 
region segmentation data 15b and special data 15c. 
Then, image output is controlled by the output control 
section 6, and a laser is outputted based upon a signal 40 
of inputted output image data 6a by the image output 
section 7. 

The following described input and output of data 
from the variable scaling section 4 to the second image 
processing section 15. 45 

As shown in FIG. 21 . the image data 3a stored in a 
line memory 17a and the region segmentation data 3b 
stored in a line memory 17b are inputted into the varia- 
ble magnification processing section 4. 

In addition, the output data from the variable magni- so 
fication processing section 4 are the special data 4c 
stored in a line memory 18a, the magnification varied 
image data 4a stored in a line memory 18b and the 
magnification varied region segmentation data 4b 
stored in a line memory 1 8c. 55 

When the scaling-processed image data 4a and the 
scaling-processed region segmentation data 4b are out- 
putted, directing data, which represent starting of data, 
the rear of each line and end of the image data, are 



added to the special data 4c. The information which rep- 
resents the starting of data, the rear of each line and the 
end of the image data, is given at the same time when 
the input image data are inputted from the image input 
section 1 . 

More specifically, in order to represent the starting 
of the scaling-processed image data 4a and the scaling- 
processed region segmentation data 4b as shown in 
FIGS. 22(a) and 22(b), start directing data 20 are out- 
putted as the directing data, which represent the start- 
ing of data, on output special data as indicated by a 
circle in FIG. 22(b). Moreover, in order to represent the 
rears of the lines of the scaling-processed image data 
4a and the scaling-processed region segmentation data 
4b as shown in FIGS. 23(a) and 23(b). rear directing 
data 21 are outputted as directing data, which represent 
the rears of the lines, on the output special data as indi- 
cated by a circle in FIG. 23(b). Further, in order to rep- 
resent the end of the whole image data of the 
magnification varied image data 4a and the scaljng- 
processed region segmentation data 4b as shown in 
FIGS. 24(a) and 24(b), image data end directing data 22 
are outputted as directing data, which represent the end 
of the whole image data, on the output special data as 
indicated by a circle in FIG. 24(b). 

In such a manner, directing data 20, 21 and 22, 
which. respectively represent the front and rear of a line 
and the end of image data are given to the special data 
4c, and the scaling-processed image data 4a and the 
scaling-processed region segmentation data 4b are 
combined so as to be outputted. As a result, a line coun- 
ter or the like is not required even in the second image 
processing section 15, and output data can be gener- 
ated by a simple arrangement of hardware so as to be 
transmitted to the asynchronizer 10. 

As mentioned above, the image processing method 
of the present embodiment reads an image, divides the 
read image into blocks composed of a plurality of picture 
elements and interpolate each picture element so as to 
variably scale the image. In accordance with this image 
processing method, possibilities of characters, photo- 
graphs and mesh dots of each picture element of the 
image are detected by the region segmentation section 
3, and the scaling-processed image data 4a as interpo- 
lated picture element data of each picture element are 
computed by the variable scaling section 4 based upon 
the detected result so as to scale the image. Meanwhile, 
at the time of the computation of the scaling-processed 
image data 4a per picture element, the region segmen- 
tation data 3b detected by the region segmentation sec- 
tion 3 are subject to the variable scaling process based 
upon the result detected by the region segmentation 
section 3 so as to be outputted as the scaling-proc- 
essed region segmentation data 4b together with the 
scaling-processed image data 4a. 

In the case where the scaling-processed image 
data 4a is desired to be outputted to the asynchronizer 
10 such as a facsimile and a personal computer, for 
example, even if the region segmentation data 3b are 
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an edge section of characters, thereby making it possi- 
ble to prevent the ghost contour. 

In accordance with the image processing method of 
the present embodiment, picture element density slope 
data S of adjacent picture elements are given to each s 
picture element of an image. Meanwhile, in the case 
where the region segmentation data X p of the picture 
element P is 0 (X p =0), the density D a of the picture ele- 
ment A which is the closest to the picture element P is 
" half tone density and the picture element density slope io 
data S p of the picture element P are positive, namely, 
data which represent that D a < D p .< D b , the density D p 
of the picture element P is converted into the value 
obtained by multiplying the half tone density and magni- 
fication together, and the density D a of the picture ele- is 
ment A is set to 0. Moreover, when the density D a of the 
picture element A are half tone density and the picture 
element density slope data S p of the picture element P 
are negative, namely, data which represent that D a > D p 
> the density D a of the picture element A is con- 20 
verted into a value obtained by multiplying the half tone 
densrty and magnification together, and the density D p 
of the picture element P is set to 0. 

In other words, when the read image is character 
data and the picture elements on a reading position is 25 
an edge of the characters, the picture elements mostly 
have half tone density. Thereafter, when the variable 
scaling process is performed according to the equation 
(1), the picture elements having the half tone density 
continue, and thus the edge becomes unclear. 30 

However, in accordance with the above method, 
when the density D a of trie picture element A which is 
the closest to the picture element P is half tone density 
and the picture element density slope data S p of the pic- 
ture element P is positive, namely, D a < D p < D b , the 35 
density D p of the picture element P is converted into a 
value obtained by multiplying the half tone density and 
magnification together, and the density D a of the picture 
element A is set to 0. Meanwhile, when the density D a 
of the picture element A is half tone density and the pic- 40 
ture element density slope data S p of the picture ele- 
ment P is negative, namely, D a > D p > D b . the density D a " 
of the picture element A is converted into a value 
obtained by multiplying the half tone density and magni- 
fication together, and the density D p of the picture ele- 45 
ment P is set to 0. 

Therefore, when a pulse width of picture elements 
for outputting a laser is modulated according to magnifi- 
cation, the density of edges of characters is further 
enhanced/and a clearer image can be obtained com- so 
pared with the case where the nearest neighbor interpo- 
lation is just used. ^ J ~ . - - 

In addition, in the image processing method of the 
present embodiment, a laser is outputted to a portion of 
picture elements where the densrty is high based upon 55 
the picture element densrty slope data on the picture 
elements to which a value obtained by multiplying the 
half tone density and magnification together was given. 
Namely, in the case where the read image is char- 



acter data and the picture element on the reading posi- 
tion is the edge of the image, when, for example, 8 
bits/picture element is processed and the picture ele- 
ment has the half tone density, the densrty of the picture 
element is 128, i.e., 80H. Therefore, an image output 
apparatus which modulates the pulse width on one pic- 
ture element so as to output a half-tone image, image 
data of 80H generates a half dot of one picture element 
in a center position of the picture elements. Then, in the 
case where the picture element where the half dot is 
generated in its center position is enlarged, a white pic- 
ture element of a half dot appears between the above 
picture element and the adjacent picture element, and 
the appearance of this white picture element is repeated 
for one picture element. Therefore, there arises a prob- 
lem that a ghost contour occurs. 

However, in accordance with the above method, a 
laser is outputted to a portion of picture elements where 
the density is high, based upon the picture element den- 
sity slope data on the picture elements to which a value 
obtained by multiplying the half tone density and magni- 
fication together was given. 

Therefore, when the edge of the character data is 
subject to the variable scaling process through the 
image processing method in claim 5, a ghost contour is 
prevented from being caused on the left or right of one 
picture element on the edge of the character data. 

[EMBODIMENT 3] 

The following describes still another embodiment of 
the present invention in reference to FIGS. 12 and 24. 
Here, for convenience of explanation, those members 
that have the same arrangement and functions, and that 
are described in the aforementioned embodiments 1 
and 2 are indicated by the same reference numerals 
and the description thereof is omitted. 

As shown in FIG. 20, the digital copying machine of 
the present embodiment is arranged so that besides the 
arrangement shown in FIG. 1 , a second image process- 
ing section 15 is provided between the variable scaling 
section 4 and the output control section 6. A scaling- 
processed image can be transmitted from the second 
image processing section 15 to an asynchronizer 10 
such as a facsimile and a personal computer. 

In other words, as described in embodiment 1, in 
the digital copying machine, the image input section 1 
reads a document image from a scanner, not shown, 
and converts the read image into the digital input image 
data 1a. Next, the shading correcting/automatic expos- 
ing section 2 performs the shading correction and the 
automatic exposure for the input image data 1a. 

In addition, the region segmentation section 3 
refers to density, etc. of picture elements in the vicinity 
of a target picture element of image data 2a which were 
subject to the shading correction and the automatic 
exposure so as to detect possibilities of characters, pho- 
tographs and mesh dots of the target picture element. 
Then, the region segmentation section 3 outputs image 
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formed on a section, which was judged to be a photo- 
graphic section, by. the interpolation of first degree. 
Therefore, the output image shown in FIG. 13 is 
obtained. 

However, in the present embodiment, when the s 
density of a picture element judged to be character sec- 
tion takes a value representing half tone, namely, in the 
case of an edge of characters, the nearest neighbor 
interpolation is not just used, but the magnification of 
the density data obtained by the nearest neighbor inter- io 
polation is enlarged by magnification and the pulse 
width is corrected. 

A judgment can be made as to whether or not the 
density of the picture element takes a value represent- 
ing half tone by whether or not the density of the picture 15 
element has a value which falls within a range of 0 to 
255. 

More specifically, as shown in FIG. 1 8, pulse widths 
(density of picture element) are corrected on sections of 
edges a and a' and edges b and b' of characters. First, 20 
a density, which was obtained by multiplying the density 
of the picture element obtained by the nearest neighbor 
interpolation by the magnification, is given to one pic- 
ture element on each side of the density slope where 
the density is high in two picture elements of the edges, 25 
namely, the picture element on the edge a' side and the 

picture element on.the.edge b side - 

Meanwhile, the density 0 is given to one picture ele- 
ment on each side of the density slope where the den- 
sity is low in two picture elements of the edges, namely, 30 
the picture element on the edge a side and the picture 
element on the edge b' side. 

According to this correction of the pulse width (den- 
sity of a picture element), the density of the picture ele- 
ments on the inside in the two picture elements of the 35 
edges of characters is multiplied by the magnification, 
and the density of the picture elements on the outside is 
changed to 0: As a result, the edge of characters is 
enhanced more than the use of the nearest neighbor 
interpolation, and thus a clear image can be obtained. 40 

The nearest neighbor interpolation is used in princi- 
ple for the section, which was judged to be the character 
section by the region segmentation section 3, namely, 
the left section of the drawing (the section marked with 
"judged to be character section"), and the pulse widths 45 
on the edges of characters are corrected. As a result, 
the edges are enhanced more than the case of FIG. 13, 
and thus a clear image can be obtained. 

In addition, in the section, which was judged to be a 
photographic section by the region segmentation sec- so 
Won 3. namely, the right half of the drawing (the section 
marked with "judged to be photographic section'*), the 
tone production becomes satisfactory by adopting the 
interpolation of first degree, and a pseudo-contour is 
hardly caused. 55 

The pulse width modulator 16 outputs images for . 
each picture element based upon the special data 4c 
including the picture element density slope data, and 
the scaling-processed y corrected image data 5a. As 



mentioned in embodiment 1 , when the special data 4c 
of 2 bits per picture element take 00 B representing 
being centered, the pulse width modulator 16 generates 
continuous ON signals so as to be centered on the pic- 
ture element. 

More specifically, as shown in FIG. 5(c), the input 
image data is 80H, i.e., has density of 128/256 and the 
input picture element density slope data are 00B repre- 
senting being centered, one-fourth (64/256) picture ele- 
ment from the front is turned off, and the next half of 
picture element is turned on, and the rest one-fourth of 
the picture element is turned off. In such a manner, the 
pulse width modulator 16 changes an ON data position 
of one picture element by adjusting an output of a laser. 

Therefore, the image data which were subject to the 
character edge process are represented by FIG. 19(a), 
for example. The small rectangles 8 represent respec- 
tively one output picture element, and numerical values, 
of the rectangles 8 represent density of each picture 
element (256 tone). 

When the input picture element density slope data 
are 00B representing being centered, an image which is 
outputted based upon this image data is represented by 
FIG. 19(b). Namely, when the input picture element 
density slope data are the 00B representing being cen- 
tered, a gap of an OFF signal, is generated on an. edge 

section. This is called as a ghost contour. - 

Therefore, in the present embodiment, when the 
position of the ON signal in one picture element is cen- 
tered, in FIG. 19(b), the output control section 6 
changes the position of the ON signal in one picture ele- 
ment by modulating the pulse width of this picture ele- 
ment so as to prevent a ghost contour. 

In other words, picture elements on second through 
fourth rectangles on the leftmost file from the top 80H 
(i.e., 128) as shown in FIG. 19(a), and the second file 
from the left is FFH (i.e., 255). As a result, the density 
slope on the picture elements is such that the density on 
the left side is low and the density on the right side is 
high. 

In addition, in FIG. 19(b), picture elements on the 
second through fourth rectangles on the rightmost file 
from the top are 80H as shown in FIG. 1 9(a), the second 
file from the right is FFH. As a result, density slope on 
these picture element is such that the density on the left 
side is high and the density on the right side is low. 

Therefore, according to this information, when the 
density slope of target picture elements is such that the 
density on the left side is low and the density, on the right 
side is high, a picture element output is changed to data 
(10B) representing being shifted to the right, and when 
the density slope of target picture elements is such that 
the density on the left side is high and the density on the 
right side is low, a picture element output is changed to 
data (01 IB) representing being shifted to the left. 

In this manner, the output control section 6 changes 
the position of the ON signal in one picture elements by 
modulating the pulse width. As a result, as shown in 
FIG. 19(c), a gap of the OFF signal is not produced on 
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of more than 0% to less than 100%, D p becomes a 
weighted linearly arithmetic mean of D a and D^. Then, 
as X p is smaller, D p takes a value which is closer to D a , 
and as X p is larger, D p takes a value which is closer to 

D ab- 5 

Therefore, even if characters and photographs or 
mesh dots coexist in an image, during the variable scal- 
ing process, a simple summing and multiplying opera- 
tion represented by the equation (1) is performed based 
upon the region segmentation data which represent the io 
possibilities of characters, photographs and mesh dots 
detected by the region segmentation means. More spe- 
cifically, the variable scaling method which is closer to 
the nearest neighbor interpolation is used for the sec- 
tion with the strong possibility of characters (X p is 15 
small), and the variable scaling method which is closer 
to the interpolation of first degree is used for the section 
with the strong possibility of photographs (X p is large). . 
As a result, more suitable density can be determined for 
. the magnification varied.data. Namely, since the density 20 
can be 'determined suitably for the characters, photo- 
graphs or mesh dots on each picture element by excel- 
lent software, the density can be determined quickly by 
a simple arrangement of hardware, and a deterioration 
in image quality can be prevented. 25 

In the present embodiment, the interpolation of first 
degree is used for determining density, but the method 
is not limited to this, and thus the interpolation of second 
or third degree can be used, for example. 

In addition, the above explanation refers to the 30 
enlarging process of the variable magnification process, 
but the image processing method of the present embod- 
iment is not necessarily limited to this, and thus this 
process can be applicable to the case where decreas- 
ing process is performed. 35 

For example, when an image in which characters 
and photographs coexist is read, the read image data 
are represented by a graph shown in FIG. 1 4. The left 
half of FIG. 1 4 shows a character region where the den- 
sity changes rapidly, arid the right half shows a photo- 40 
graphic region in which density changes continuously 
and comparatively mildly. 

When the nearest neighbor interpolation, in which 
density of a picture element existing in the nearest 
neighborhood of a target picture element of a reduced 45 
image is used as the density of the target picture ele- 
ment, isjjsed for the whole image at the time of reduc- 
ing the read image data to half, an output image shown 
in FIG. 1 5 is obtained. Namely, in the left haft of the out- 
put image, i.e., the character region, an edge is so 
enhanced comparatively, and thus the image becomes 
— . ~ L -clear, but in the right half, i.e., the photographic region, 
tone production is deteriorated, and thus a pseudo-con- 
tour is liable to be caused. 

In addition, when the read image data shown in 55 
FIG. 14 are reduced to half by the interpolation of first 
degree which uses a weighted linearly arithmetic mean 
of the density of a picture element which exists in the 
nearest neighborhood of a target picture element of an 



output image and the density of a picture element which 
is the second closest to the target picture element as 
the density of the target picture element, an output 
image shown in FIG. 16 is obtained. Namely, in the right 
half of the output image, i.e., the photographic region, 
the tone production becomes satisfactory, and thus the 
pseudo-contour is hardly caused, but in the left half, i.e., 
the character region, an edge becomes unclear. 

Therefore, in the present embodiment, when the 
region segmentation data are judged to be the charac- 
ter section, the nearest neighbor interpolation is used, 
and when the region segmentation data are judged to 
be the photographic section, the interpolation of first 
degree is used. A graphic of output image data obtained 
by the above method is shown in FIG. 17. In the left half 
of the FIG. 17, i.e., the region judged to be the character 
section, the edge is enhanced, and thus a clear image 
is obtained, and in the right half, i.e., the region judged 
to be the photographic section, the tone production 
becomes satisfactory, and thus a pseudo-contour is 
hardly caused. 

In such a manner, the region segmentation data is 
referred to at the time of the reducing, and the variable 
magnif ication processing method which is closer to the 
nearest neighbor interpolation is used in a section with 
the strong possibility of characters, and the variable 
magnification method which is closer to the interpola- 
tion of first degree is used in a section with the strong 
possibility of photographs. As a result, the density of the 
reduced data can be determined more suitable. 

[EMBODIMENT 2] 

The following describes another embodiment of the 
present invention on reference to FIGS. 5, 10, 18 and 
19. Here, for convenience of explanation, those mem- 
bers that have the same arrangement and functions, 
and that are described in the aforementioned embodi- 
ment 1 are indicated by the same reference numerals 
and the description thereof is omitted. 

In the image processing method of the aforemen- 
tioned embodiment, if the possibility of characters is 
strong, the magnification is varied by the nearest neigh- 
bor interpolation. However, if the nearest neighbor inter- 
polation is used for an edge of characters, the edge is 
not enhanced sufficiently. 

Therefore, in the image processing method of the 
present embodiment, the nearest neighbor interpolation 
is not just used for an edge of characters, a method of 
multiplying density data obtained by the nearest neigh- 
bor interpolation by enlargement scale of the various 
scaling (i.e.. "to enlarge by magnification") is adopted. 

An output image which was subject to the variable 
scaling process is shown in FIG. 18. 

In other words, in order to enlarge a read picture 
element shown in FIG. 10 twice, when the region seg- 
mentation data is referred to and are judged to be char- 
acter section, the nearest neighbor interpolation is 
used. Moreover, the variable scaling process is per- 
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3b, the variable magnification process which is closer to 
the nearest neighbor interpolation is used on a section 
with the strong possibility of characters, and the variable 
magnification process which is closer to the interpola- 
tion of first degree is used on a section with the strong 5 
possibility of photographs. As a result, the density data 
which is scaling-processed can be made the most suit- 
able. 

As mentioned above, in the image processing 
method of the present embodiment which reads an 10 
image and divides the read image into blocks com- 
posed of a plurality of picture elements and performs a 
variable scaling process such as enlargement and 
decreasing of an image by making interpolation per pic- 
ture element, possibilities of characters, photographs 15 
and mesh dots on each picture element on the image 
are detected by the region segmentation section 3, and 
interpolated picture element data per picture element 
are calculated by the variable scaling section 4 based 
upon the results of the detection so that scaling of the 20 
image is performed. 

In other words, in the conventional method of 
selecting the nearest neighbor interpolation or the inter- 
polation of first through third degrees, at the time of the 
enlarging process of the variable scaling process, i.e., 25 
enlargement, when the nearest neighbor interpolation is 
selected for the case where characters, photographs, 
etc. coexist in a document image, a pseudo-contour is 
occasionally caused on the photograph region, and 
when the interpolation of first through third degrees is 30 
selected, an edge of the characters becomes unclear. 

However, in accordance with the above method, the 
possibilities of characters, photographs and mesh dots 
on each picture element on an image are detected by 
the region segmentation section 3, and the interpolated 35 
picture element data per picture element are computed 
by the variable scaling section 4 based upon the 
detected results so that scaling of the image is per- 
formed; 

Therefore, a section with the strong possibility of 40 
characters is enlarged by the nearest neighbor interpo- 
lation or the like, and thus an edge of the enlarged char- 
acters is prevented from becoming unclear. Meanwhile, 
a section with the strong possibility of photographs is 
enlarged by calculation which is closer to the interpola- 45 
tion of first through third degrees, and thus a pseudo- 
contour of the enlarged photograph is prevented from 
being caused. 

As a result, even if characters, photographs and 
mesh dots coexist on an image read by a scanner, a so 
deterioration in image quality can be prevented by scal- 
ing the image according to the characters, photographs 
or the mesh dots. 

In addition, in the image processing method of the. 
present embodiment, the region segmentation data rep- 55 
resenting the possibilities of characters, photographs 
and mesh dots detected by the region segmentation 
section 3 can take a value X which falls within a range of 
0 to N-1 (N is an integral number of not less than 2) (the 



smaller the value X is, the stronger the possibility of 
characters is, and the larger the value X is, the stronger 
the possibility of photographs or mesh dots). Moreover, 
when the region segmentation data of an interpolation 
picture element P whose density is should be deter- 
mined is represented by X p , the density of the picture 
element A which is the closest to the picture element P 
is represented by D a , the density of the picture element 
B which is the second closest to the picture element P is 
represented by D b . a distance between the picture ele- 
ments P and A is represented by PA, and a distance 
between the picture elements P and B is represented by 
PB, the variable magnification processing section 4 
computes the density D p of the picture element P 
according to the aforementioned equation (1). 

In other words, sections of characters and sections 
of photographs and mesh dots mostly coexist on an 
actual image, and thus if the variable magnification 
method such as pattern matching is used for each pic- 
ture element of the above-mentioned image, there 
arises problems that a lot of memories are required for 
performing precise variable magnification process and 
that the processing time becomes longer. 

However, in accordance with the above method, the 
variable magnification processing section 4 performs 
the computation according to the equation (1). Then, in 
the equation (1 ), if the region segmentation data Xp take - 
a value 0 representing complete character, K = 0 and 
D p = D a . Namely, this means the variable scaling 
process by means of the nearest neighbor interpolation, 
Meanwhile, if the region segmentation data X p 
takes a value N-1 representing a perfect photograph, for 
example, the density D p becomes as follows: 

D p = (PB - D a + PA - D b ) / (PA + PB) 

and thus D p becomes a weighted linearly arithmetic 
means of the density D a of the picture element A which 
is the closest to the picture element P and the density 
D b of the picture element B which is the second closest 
to the picture element P. Namely, this means the varia- 
ble scaling process by means of the interpolation of first 
degree. 

If the region segmentation data X p takes a value 
between the possibilities of characters and photographs 
which fall within a range of more than 0% to less than 
100%, the density can be calculated based upon the 
weight according to the equation (1 ). 

Here, when the weighted linearly arithmetic means 
of D a and D b is represented by the aforementioned 
equation (1) can be changed as follows: 

. D p = {i-(X p / (N-1))} x D a + (X p / (N-1)) xD^ 

As is clear from the above equation, when N is an 
integral number of not less than 3. the region segmenta- 
tion data Xp fulfills a relationship 0 < X p < N-1 , 
namely, obtains a value between the possibilities of 
characters and photographs which falls within a range 
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the same density make a pair, are obtained. According 
to this method, an image having a comparatively clear 
edge is obtained for a binary image such as characters. 
However, a variation of the density cannot be precisely 
reproduced for an image such as a photographic image 5 
whose density is successively changed. As a result, a 
so-called pseudo-contour is caused. 

Here, the pseudo-contour is a contour which is 
caused when continuity of variation. of density in a vari- 
able density image is lost, and does not exist in an orig- '"10 
inal image (see p. 481 "Handbook of Image Analysis", 
first edition published by the Publishing Foundation, the 
University of Tokyo: the supervision of Mikio Takagi and 
Shimoda). 

Therefore, as for an image such as a photographic 15 
image whose density is successively changed, it is pref- 
erable that the variable scaling process is performed by 
using the interpolation of first degree. 

In other words, the original image read data shown 
in FIG. 7 are enlarged twice by using the interpolation of 20 
first degree, they are represented FIG. 9. 

According to the interpolation of first degree, a pic- 
ture element having density which is the same as a 
mean of densities of two read image data, is interpo- 
lated between the -two continuous read image data. 25 
According to this method; as for an image such as a 
photographic image whose density is successively 
changed, the variation of density of the original image 
can be reproduced comparatively definitely and faith- 
fully, but as for a binary image such as characters, an 30 
image whose contour is not clear is reproduced. 

Therefore, in the case where characters, photo- 
graphs, etc. coexist in an image, if the nearest neighbor 
interpolation or the interpolation of first degree is 
selected indiscriminately, there arises a problem. 35 

This is described concretely on reference to the 
drawings.. 

First, read density data which is obtained by read- 
ing an image in which characters and photographs 
coexist are shown in FIG. 10, for example. The left half 40 
of FIG. 10 illustrates a character region, and its feature 
is such that the density changes rapidly. On the con- 
trary, the right half of FIG. 10 illustrates a photographic 
region, and its feature is such that the density changes 
continuously and comparatively mildly. 45 

When the read image is enlarged twice by the near- 
est neighbor interpolation, the image represented by 
FIG. 11 is obtained. 

In this case, since the nearest neighbor interpola- 
tion is used, the edge of the left half, namely, the char- so 
acter region of the image is comparatively emphasized, 
and thus the image becomes clear. However, the right — 
half, nameiy, the photographic region has unsatisfactory 
tone production, and thus a pseudo-contour is liable to 
be caused. 55 

Meanwhile, when the read image shown in FIG. 10 
is enlarged twice by the interpolation of first degree, the 
image represented by FIG. 12 is obtained. 

In this case, the interpolation of first degree causes 
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an image whose left half, namely, character region has 
an unclear edge. However, the right half, namely, the 
photographic region has satisfactory tone production, 
and thus a pseudo-contour is difficultly caused. 

In such a manner, it is not preferable that the near- 
est neighbor interpolation or the interpolation of first 
degree is indiscriminately selected for a whole image. 

Therefore, in the present embodiment, in the case 
where characters and photographs coexist in a read 
image, the nearest neighbor interpolation or the like is 
used for the characters, and the interpolation of first 
degree or the like is used for the photographs. 

The following describes the variable magnification 
process using the above methods. 

In other words, in the present embodiment, the 
region segmentation section 3 detects possibilities of 
characters, photographs and mesh dots on a picture 
element so as to output the detected possibilities as the 
region segmentation data 3b. Then, calculation is made 
according to the equation (1) based upon the region 
segmentation data 3b. When the output picture element 
region segmentation data Xp takes a value representing 
the strongest possibility of characters, namely, Xp = 0, 
the equation (1) becomes as follows: 

D P=°a 

and thus the nearest neighbor interpolation is used. 
Moreover, when the output picture element region seg- 
mentation data Xp takes a value representing the 
strongest possibility of photographs, namely, Xp = 7, the 
equation (1) becomes as follows: 

D p = (PB • D a + PA -D b )/(PA + PB) 

and thus the interpolation of first degree is used. 

An output image obtained by the above computa- 
tion is shown in FIG. 13. In other words, FIG. 13 is a 
graph which shows outputs in the case where when the 
read picture element shown in FIG. 1 0 is enlarged twice 
according to the region segmentation data 3b, two kinds 
of the variable scaling processes are used. Namely, 
when the picture element is judged to be a character 
section, the nearest neighbor interpolation is used, and 
when the picture element is judged to be a photographic 
section, the interpolation of first degree is used. 

In this case, on the section which was judged to be 
the character section in the region segmentation section 
3, namely, the left section, the edge is enhanced by 
using the nearest neighbor interpolation as the variable 
scaling method, and thus a clear image is obtained. 
Moreover, in the region segmentation section 3, when 
the interpolation of first degree is used as the variable 
scaling method for the section which was judged to be a 
photographic section, namely, the right half, the tone 
production becomes satisfactory, and thus a pseudo- 
contour is difficultly caused. 

In such a manner, at the time of variable magnifica- 
tion process, referring to the region segmentation data 
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Meanwhile, when X p - 0. D a > D p > D b , and D p is on 
the right side of D a , S p becomes data representing that 
a picture element is outputted. in a position which is 
shifted to the right, namely, S p = 10B. Furthermore, 
when Xp = 0 and the condition of D a , D b and D p is other 5 
than the above. S p becomes data representing that a 
picture element is outputted in a central position, 
namely, S p = OOB . 

In addition, when X p ^ 0, namely, the picture ele- 
ment density slope data S p are judged not to be charac- 10 
ters in the region segmentation process, Sp becomes 
data representing that a picture element is outputted in 
the central position, namely, S p = OOB . 

When output picture element P is a front or rear of 
a line or an end of a page, corresponding directing data '15 
are added to the picture element density slope data S p 
so that the special data 4c are outputted. 

As shown in FIG. 1, the data of the output picture 
elements P, namely, the scaling-processed image data 
4a, the scaling-processed region segmentation data 4b 20 
and the special data 4c are respectively inputted to the 
output control section 6 after the scale-processed 
image data 4a is subject to the y correction. 

The following describes a detailed operation of the 
output control section 6. 25 

As shown in FIG. 4, in the output control section 6, 
a pulse. width is modulated by the pulse widtrvmodulator 
16. 

Inputs of the pulse width modulator 16 are image 
data of 8 bits per picture element which are composed .30 
of the scaling-processed y corrected image data 5a and 
the magnification varied region segmentation data 4b, 
and picture element density slope data of 3 bits per pic- 
ture element which are included in the special data 4c. 

The image data and the picture element density 35 
slope data are synchronously inputted to the pulse 
width modulator in parallel. Outputs of the pulse width 
modulator 16 are serial video data which are divided 
into 256 per picture element. The pulse width modulator 
16 control a laser of the image output section 7 accord- 40 
ing to pulses of an ON signal of 1/256 picture element 
based upon the input image data of 8 bits per picture 
element, namely, with value of 256, and controls the 
density of one picture element by 256 steps. 

In addition, the pulse width modulator 16 refers to 45 
the density slope data so as to determine a position of 
one picture element where continuous ON signals are 
allowed to be generated. Namely, when the picture ele- 
ment density slope data Sp of 3 bits per picture element 
are 01 B which represents that they are shifted to the so 
left, the continuous ON signals are allowed to be gener- 
ated at the front of the picture element, and when the 
picture element density slope data are 1 0B which repre- 
sents that they are shifted to the right, the continuous 
ON signals are allowed to be generated at the rear of 55 
the picture element. Moreover, when the picture ele- 
ment density slope data Sp are OOB which represents 
that they are centered, the continuous ON signals are. 
allowed to be generated at the center of the picture ele- 



ment. 

More concretely, as shown in FIG. 5(a), when input 
image data are 80 H, i.e., have 128/256 density, and the 
input picture element density slope data of the special 
data are 10B, namely, they are shifted to the left, half 
(128/256) picture element from the front of the picture 
element is turned on, and the rest of half picture ele- 
ment is turned off. 

In addition, as shown in FIG. 5(b), when input 
image data arie 80 H. i.e., have 128/256 density, and the 
input picture element density slope data of the special 
data are 01B, namely, they are shifted to the right, half 
(128/256) picture element from the front of the picture is 
turned off. and the rest of a half picture element is 
turned on. 

Furthermore, as shown in FIG. 5(c). input image 
data are 80 H, i.e.. have 128/256 density, and the input 
image density slope data of the special data are 00B, 
namely, they are centered, one-fourth (64/256) picture 
element from the front of the picture element is turned 
off, a next half picture element is turned on. and the rest 
of one-fourth picture element is turned off. 

In such a manner, the pulse width modulator 16 
adjusts outputs of the laser so as to change a position of 
ON data within one picture element. 

The following details a variable scaling process of 
an image with variable density, i.e., an image with den- 
sity tone according to the equation ( 1 ). 

An example is given as to an original image haying 
density tone shown in FIG. 6. A vertical axis represents 
the density of the original image. In this case, when the 
original image is a white image, the density value is 0, 
and when the original image is a black image, the den- 
sity value is 255. Moreover, a horizontal axis represents 
a position where the above density is obtained. 

When an original image having density tone shown 
in FIG. 6 is read by the image input section 1 , as shown 
in FIG. 7, the original image is divided according to each 
picture element. A vertical axis in FIG. 7 represents 
density values, which are integral numbers of 8 bits, i.e., 
0 to 255. On the horizontal axis, the position in FIG. 6 is 
divided by a unit of one read picture element, and rec- 
tangles of the graph respectively represent the density 
values of the read picture elements per read picture ele- 
ment unit. 

Next, when the read picture elements shown in 
FIG. 7 are enlarged twice by using the nearest neighbor 
interpolation, the read picture elements are represented 
by FIG. 8. In FIG. 8, a vertical axis represents density 
values which are integral numbers of 8 bits, i.e., 0 to 
255. Moreover, a horizontal axis represents a position in 
a write picture element unit. Further, rectangles of the 
graph respectively represent density values of a write 
picture element in a unit of one write picture element. 

Since the variable scaling process in this case is 
the nearest neighbor interpolation, data, in which a rec- 
tangle with the same shape is arranged next to each 
rectangle of the read picture element unit shown in FIG. 
7, namely, data, in which two picture elements having 
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ing section 4 in only the horizontal scanning direction of 
the digital copying machine. 

The y correcting section 5 performs the y correcting 
process on the inputted seal ing -processed image data 
4a. 5 

The output control section 6 is also called as a 
pulse width modulator, and controls an output of an 
image. The image output section 7 outputs a laser 
based upon a signal of the output image data 6a input- 
ted to the image output section 7. 10 

In the digital copying machine of the present 
embodiment, the input image data 1a, the image data 
2a and 3a, the scaling-processed image data 4a and 
the scaling-processed y corrected image data 5a are 
respectively composed of 8 bits per picture element 15 
(namely, each picture element takes a value of 256). 
Moreover, the output image data 6a is aggregate of sig- 
nals with 256 pulses per picture element. The output 
control.section 6 creates data as to how many pulses of 
256 pulses obtained by dividing one picture element 20 
into 256 is turned on, based upon a value of the inputted 
scaling-processed y corrected image data 5a, and rep- 
resents-density by outputting the created data. 

In addition, the region segmentation data 3b and 
the scaling-processed region segmentation data 4b are 25 
respectively composed of 3 bits per picture element 
(namely, each picture element takes a value of 8). Fur- 
ther, the special data 4c are composed of a total of 5 
bits: 2 bits of the directing data representing the front 
and rear of a line and end of image data; and 3 bits of 30 
the picture element density slope data in a picture ele- 
ment being processed currently. Moreover, the special 
data 4c are combined with the scaling-processed region 
segmentation data 4b so as to take a value of 8 bits per 
picture element. 35 

The following describes an image processing 
method' relating to the variable scaling process in the 
digital copying machine having the above arrangement. 

As shown in FIG. 2, when density in a position P of 
a picture element after the variable scaling process, 40 
namely, output picture element density D p is deter- 
mined, a simple summing and multiplying operation is 
performed by using a picture element A which has den- 
sity D a and region segmentation data X a , and is the 
nearest to the picture element P (i.e., "nearest neighbor 45 
"picture element"), a picture element B which has den- 
sity D b and region.segmentation data and is the sec- 
ond nearest to the picture element P (i.e., "second 
nearest neighbor picture element"), and distances PA 
and PB between the picture elements P, A and B. so 

The above summing arid multiplying operation is 
performed in the variable scaling section 4. 

As shown in FIG. 3, the region segmentation data 
X a and the density D a in the nearest neighbor picture 
element A, and the region segmentation data X b and 55 
the density D b in the second nearest neighbor picture 
element B are inputted into the variable scaling section 
4. Outputs of the variable scaling section 4 are output 
picture element region segmentation data Xp as the 



magnification varied region segmentation data 4b, out- 
put picture element density D p , data representing a 
position of the output picture element used in the output 
control section 6, i.e., the picture element density slope 
data S p , and bits for controlling the directing data repre- 
senting the front and rear of a line and the end of an 
image data. 

In the variable scaling section 4, when the output 
picture element region segmentation data X p is com- 
puted, a relationship X p = X a is fulfilled by the nearest 
neighbor interpolation. Namely, the nearest neighbor 
interpolation directly uses data of a picture element 
exist in the nearest neighbor as the output data of pic- 
ture element. 

Meanwhile, the output picture element density D p is 
computed according to the following equation. 

D p = (1-K)xD a+ KxD b (1) 

(Here, K = (X p /N-1 ) x (PA / (PA + PB)) (2) 

In the present embodiment, since a number of sep- 
arations of the region segmentation data is set to 8, the 
value N-1 in the equation (2) is computed according to 
the equation N-1 = 8 - 1 =7. 

When the output picture element region segmenta- 
tion data X p takes a value representing that the possibil- 
ity of characters is strongest, namely, X p = 0, the 
equation (1) becomes as follows: 

D p =D a 

and thus the equation (1) represents the nearest neigh- 
bor interpolation. Namely, the nearest neighbor interpo- 
lation directly uses the density of the picture element A 
as the density of the output picture element D. 

In addition, when the output picture element region 
segmentation data Xp takes a value representing the 
strongest possibility of photographs, namely, 
X = N-1 = 7 , the equation (1) becomes as follows: 



D p = (PB-D £ 



+ PA * D b ) / (PA + PB) 



and thus the equation (1) represents the interpolation of 
first degree. Namely, the interpolation of first degree 
uses linearly weighted mean of weighing the density of 
the picture element A with the density of the picture ele- 
ment B as the density of the output picture element D is 
determined. 

Next, when Xp = 0, namely, the block of a picture 
element is judged to be characters in the region seg- 
mentation process, the relationship D a < D p < D b is ful- 
filled. Moreover, when D p is on the left side of D a , data 
representing the position of an output picture element in 
one picture element, i.e., the picture element density 
slope data S p the picture element density slope data Sp 
becomes data representing that a picture element is 
outputted in a position which is shifted to the left, 
namely, S p = 01 B (B is binary display). 
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get picture elements. 

Therefore, in the present embodiment, as disclosed 
in the U.S. patent application Serial No. 08/540,580 
(Japanese Patent Application No. 6-264232/1994) by 
the inventors of the present invention, an image signal s 
obtained by scanning a document is subject to an iden- 
tification process which identifies as to whether each 
picture element exists in a character region, a photo- 
graphic region or a mesh dot region, and when each 
picture element is subject to an image process accord- io 
ing to the results of the identification process, certain 
picture element data of the image signal is used as a 
target picture element, and image data in a local block, 
which composed of the target picture element and a plu- 
rality of picture elements in the vicinity of the target pic- is 
ture element, are stored in a block memory. 

Next, according to the image data in the local block 
stored in the block memory, a plurality of feature param- 
eters, which respectively represent features of the char- 
acter region, the 'photographic region and the mesh dot 20 
region, is obtained. A multi-dimensional identification 
process is executed by identification means which 
selects each of the character region, the photographic 
region and the mesh dot region divided by borderlines 
including a non-linear characteristics in a multi-dimen- 25 
sional plane including axis of the above feature param- 
etersand which is composed of a neural network which 
learned beforehand for receiving each feature of the 
plural feature parameters and outputting region identifi- 
cation information according to each input. Namely, the . 30 
identification process is performed not by setting a 
threshold value for each feature parameter but based on 
the borderlines including non-linear characteristic 
based on which the multi-dimensional space is divided 
by feature parameters. 35 

According to the described method, even if an iden- 
tification cannot be performed with a desired accuracy 
when considering only one feature parameter, by taking 
plural feature parameters into consideration, the identi- 
fication of the region where the target picture element is 40 
located can be performed with an improved accuracy. 
Furthermore, as a multi -dimensional identification proc- 
ess is performed using a neural network which receives 
each input of plural parameters, an identification can be 
performed with very high precision. 45 

In addition; the region identification information out- 
putted by the identification means is data which respec- 
tively, represent likelihoods of the character region, the 
photographic region and the mesh dot region in a region 
of the block in which the target picture element exists by so 
numerals; Namely, the identification means outputs a 
possibility of characters which is a numeral representing 
a character region in a region of a block where a target 
picture element exists, a possibility of photographs 
which is a humeral representing a photographic region 55 
in a region of a block where a target picture element 
exists, and a possibility of mesh dots which is a numeral 
representing a photographic region in a region of a 
block where a target picture element exists. 



According to the above manner, the possibilities of 
characters, photographs and the mesh dots in each pic- 
ture element are detected. Then, data, which are used 
for obtaining the possibilities of characters, photographs 
and mesh dots from the feature parameters (for exam- 
ple, a difference between the maximum density value 
and the minimum density value in a certain block for pic- 
ture elements in the vicinity of the target picture ele- 
ment), are region segmentation data, and the region 
segmentation data are determined by the aforemen- 
tioned method. 

Then, as mentioned above, in the present embodi- 
ment, the above-mentioned data, namely, the region 
segmentation data 3b, can take a value X which falls 
within the range of 0 to N-1 (N: an integral number of not 
less than 2). 

In the space filtering process suggested in the U.S. 
Patent Application Serial No. 08/540,580, various filters 
in which filter coefficients were predetermined are 
selected based upon the identification signal. More con- 
cretely, the filter coefficients are determined per proc- 
essed picture element based upon the data 
representing likelihood of each region by numerals so 
that the space filtering process is performed. 

Next, the variable scaling section 4 performs the 
variable.scaling process on the inputted image data 3a 
and region segmentation data 3b, namely, enlarges or 
reduces of the inputted image data 3a and region seg- 
mentation data 3b so as to output scaling-processed 
image data 4a which are scaling-processed image data, 
and magnification varied region segmentation data 4b 
which are scaling-processed region segmentation data, 
and judges slope of density of a current picture element 
by referring to peripheral picture elements so as to out- 
put special data 4c. 

At the time of the variable scaling process, interpo- 
lation represented by an operation expression, men- 
tioned later, is used as the image data 3a, and nearest 
neighbor interpolation is used for processing the region 
segmentation data 3b. Moreover, the special data 4c 
are composed of directing data, which represent the 
front and rear of a line of the region segmentation data 
3b and end of the image data, and data, which repre- 
sents slope of density of a picture element being proc- 
essed currently (i.e., "picture element density slope 
data"). 

in addition, the picture element density slope data 
are outputted as data representing "No slope" except 
that the region segmentation data 3b has a strong pos- 
sibility of characters. Namely, the variable scaling sec- 
tion 4 outputs "No slope" as the picture element density 
slope data except that the region segmentation data 3b 
has a value representing a strong possibility of charac- 
ters (here, 0). 

Since the variable scaling process for an image in 
the vertical scanning direction of a digital copying 
machine is adjusted by changing a speed of an optical 
system, the image data 3a is subject to the variable 
scaling process by the variable magnification process- 
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the possibilities of characters, photographs and mesh 
dots, take a value X which falls within the range of 0 to 
N-1 (N: an integral number not less than 2). The smaller 
the value X is, the stronger the possibility of characters 
is, and the larger the value X is, the stronger the possi- 5 
bilities of photographs and mesh dots are. In the 
present embodiment, N=8, for example, is adopted. 
Therefore, when the possibilities of photographs and 
mesh dots are the strongest, the region segmentation 
- data 3b take the value X=7. - • - 10 

The following describes a technique of detecting 
the possibilities of characters, photographs and mesh 
dots in each picture element. The possibilities of char- 
acters, etc : can be detected by the prior art. but in the 
present embodiment, a few improvements are made on 15 
the prior art. 

As the prior art, for example, there exists an art of 
dividing an image into blocks composed of a plurality of 
picture elements and identifying the image per block by 
using pattern matching or feature parameters which 20 
represent properties of a character image and a mesh 
dot image so as to detect the possibilities of characters, 
etc. 

Since the image identification method using the . 
pattern matching requires preparation of many patterns, 25 
there arises . a problem- that a memory capacity 
becomes enormous and that this method lacks versatil- 
ity. For this reason, the image identification method 
using the feature parameters is adopted increasingly at 
present. 30 

As the image identification method using the fea- 
ture parameters, Japanese Unexamined Patent Publi- 
cation No. 61-194968/1986 (Tokukaisho 61-194968) 
discloses a mesh dot photographic region identification 
method of individually measuring changes in signal lev- 35 
els of two picture elements which spatially continue in 
the two cases where the two picture elements continue 
in a horizontal scanning direction and continues in a 
vertical scanning direction and comparing sum totals of 
measured amounts in the blocks respectively with pre- 40 
determined values so as to identify the image according 
to the compared results. 

In addition, as another method using the feature 
parameters, Japanese Unexamined Patent Publication 
No. 62-147860/1987 (Tokukaisho 62-147860) discloses 45 
a half -tone facsimile signal processing method. In this 
method, a difference between a maximum signal level 
and a minimum signal level in the blocks is obtained, 
; and the difference value is compared with a predeter- 
- v mined value. Then, when the level difference is smaller so 
"' than the predetermined value, a judging signal, which 
- - : " - : * represents that the signal level in a section including a -* 
photograph is changed mildly, is outputted, whereas : 
when the level difference is larger than the predeter- 
mined value, a judging signal, which represents that the 55 
signal level in a section including contour of characters 
and a photograph or a mesh dot photograph is changed 
intensely, is outputted. Moreover, a number of changes 
between the two signal levels of the two picture ele- 



ments which continues spatially is compared with a pre- 
determined value according to order of access which is 
predetermined in the blocks, and according to the com- 
pared results, when the number of changes is larger 
than the predetermined value, a judging signal, which 
represents that the block is a mesh dot section, is out- 
putted. whereas when the number of changes is smaller 
than the predetermined value, a judging signal, which 
represents that the block is not a mesh dot section, is 
- outputted. Then, the picture elements in the blocks are 
subject to a signal process according to the respective 
judging signals. 

An image process which improves image quality, a 
space filtering process is conventionally used. As an 
image processing method for improving the image qual- 
ity by using the filtering process, for example, Japanese 
Examined Patent Publication No. 5-147860/1993 (Toku- 
kohei 5-147860) discloses a half-tone facsimile signal 
processing method. In this method, a space filter which 
makes an image signal smooth and a space filter which 
enhances an image signal are prepared, and a signal, 
which smoothed the image signal and/or a signal which 
enhanced the image signal are/is mixed or selected 
based upon an output of edge detecting means which 
detects an edge section of the image signal. Moreover, 
another method is disclosed in Japanese Unexamined ------ 

Patent Publication No. 63-246076/1 988 (Tokukaisho 63- 
246076). In this method, a space filter, such as a filter 
processing device, which removes a mesh dot compo- 
nent is prepared, and when an edge section is not 
extracted by edge extracting means which extracts an 
edge section of an image signal, a signal, which has 
been subject to the filtering process for removing the 
mesh dot component, is outputted, whereas when an 
edge section is extracted, a signal, which has not been 
subject to the filtering process yet, is outputted. 

However, the above-mentioned conventional image 
identification method has a disadvantage that misjudg- 
ment of the image identification occurs. 

The cause for the misjudgment of the image identi- 
fication is considered to be unsuitable feature parame- 
ters, namely, the feature parameters do not sufficiently 
represent respective properties of the regions. Besides, 
unsuitable classifying method for the image identrfica- 
tion according to an amount of features obtained by the 
feature parameters and unsuitable selection of a thresh- 
old value for the classification also cause the misjudg- 
ment of the image identification. 

In the conventional method of classifying and iden- 
tification the blocks according to an amount of features 
obtained by the feature parameters so as to execute the 
filtering process on target picture elements in the blocks 
using a prepared space filter according to the identified 
results, great influence is exerted on image quality at 
the time of misjudgment, and an amount of features 
owned by the target picture elements reflects only lim- 
ited filter characteristics. For this reason, there arises a 
problem that a delicate process such as the filtering 
process cannot be performed most suitably for the tar- 
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picture elements shown in FIG. 7 are enlarged by twice. 

FIG. 9 is a graph which shows an output in the case 
of using interpolation of first degree when the read pic- 
ture elements shown in FIG. 7 are enlarged by twice. 

FIG. 10 is a graph which shows read density data 
when an image in which characters and photographs 
coexist is read. 

FIG. 1 1 is a graph which shows an output in the 
case of using the nearest neighbor interpolation when 
the read picture elements shown in FIG. 10 are 
enlarged by twice. 

FIG. 12 is a graph which shows an output in the 
case of using the interpolation of first degree when the 
read picture elements shown in FIG. 10 are enlarged by 
twice. 

FIG. 13 is a graph which shows an output in the 
case of using the nearest neighbor interpolation in a 
section judged to be characters and using the interpola- 
tion of first degree in a section judged to be a photo- 
graph when the read picture elements shown in FIG. 10 
are enlarged by twice. 

FIG 14 is a graph which shows read density data 
when an image in which characters and photographs 
coexist is read 

FIG 15 is a graph which shows an output in the 
case ot using the nearest neighbor interpolation when 
the read picture elements shown in FIG. -14 are reduced 
to half. 

FIG. 16 is a graph which shows an output in the 
case of using the interpolation of first degree when the 
read picture elements shown in FIG. 14 are reduced to 
half. 

FIG. 17 is a graph which shows an output in the 
case of using the nearest neighbor interpolation in a 
section judged to be characters and using the interpola- 
tion of first degree in a section judged to be a photo- 
graph when the read picture elements shown in FIG. 14 
are reduced to 1/2. 

FIG. 18 is a graph which shows an output in the 
case of giving an edging process to a section judged to 
be characters in FIG. 13. 

FIGS. 19(a) through 19(c) are explanatory drawings 
which show effects of an ON signal position operation in 
the picture elements by means of the pulse width mod- 
ulator: FIG. 19(a) is a drawing which shows density val- 
ues (256 tones) of the picture elements; FIG. 19(b) is a 
drawing which shows an output when a picture element 
density slope data is fixed to the center; and FIG. 19(c) 
is a drawing which shows an output when the pulse 
width is outputted shifted to the side where the density 
is high based upon data representing the density slope. 

FIG. 20 is a block diagram which shows an arrange- 
ment of the digital copying machine which adopts an 
image processing method according to another embod- 
iment of the present invention. * 

FIG. 21 is a block diagram which shows an arrange- 
ment of a variable scaling section in the digital copying 
machine. 

FIGS. 22(a) and 22(b) are explanatory drawings 



which show states that when scaling -processed image 
data and scaling-processed region segmentation data 
are outputted simultaneously, their respective directing 
data are outputted simultaneously: FIG. 22(a) is a draw- 
s ing which shows the front of each line of each data 
inputted to the variable magnification processing sec- 
tion; and FIG. 22(b) is a drawing which shows the front 
of each line of each data outputted from the variable 
magnification processing section. 
10 FIGS. 23(a) and 23(b) are explanatory drawings 

which show states that when scaling-processed image 
data and scaling-processed region segmentation data 
are outputted simultaneously, their respective directing 
data are outputted simultaneously: FIG. 23(a) is a draw- 
is ing which shows the rear of each line of each data input- 
ted to the variable scaling section; and FIG. 23(b) is a 
drawing which shows the rear of each line of each data 
outputted from the variable scaling section. 

FIGS. 24(a) and 24(b) are explanatory drawings 
20 which show states that when scaling-processed data 
and scaling-processed region segmentation data are 
outputted simultaneously, their respective directing data 
are outputted simultaneously: FIG. 24(a) is a drawing 
which shows an end portion of an image data of each 
25 data inputted into the variable scaling section; and FIG. 
2 4(b) is a drawing which shows an .end portion of image 
data of each data outputted from the variable magnifica- 
tion processing section. 

30 DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[EMBODIMENT 1] 

35 The following describes one embodiment of the 
present invention on reference to FIGS. 1 through 1 7. . 

As shown in FIG. 1 , a digital copying machine as an 
image processing apparatus of the present embodiment 
is provided with an image input section 1 . a shading cor- 

40- recting/automatic exposing section 2. a region segmen- 
tation section 3 as region segmentation means, a 
variable scaling section 4 as computing means, a y cor- 
recting section 5, an output control section 6 and an 
image output section 7. 

45 The image input section 1 reads a document image 
from a scanner, not shown, so as to convert the read 
image into digital input image data 1 a. The shading cor- 
recting/automatic exposing section 2 processes shad- 
ing correction and automatic exposure of the input 

>o image data 1a. 

While referring to density, etc. of picture elements in 
the vicinity of target picture elements of the image data 
2a which were subject to the shading correction and the 
automatic exposure, the region segmentation section 3 

»5 detects a possibility of characters, a possibility of photo- 
graphs and a possibility of mesh dots of the target pic- 
ture elements of the image data 2a so as to output 
image data 3a and region segmentation data 3b. 

The region segmentation data 3b, which represents 
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given also to the scaling-processed region segmenta- 
tion data, the scaling-processed image can be output- 
ted to an external image input/output device such as a 
facsimile and a personal computer by combining these 
data with the region segmentation data. 5 

It is desirable that the image processing method 
further has: the step of simultaneously outputting the 
scaling-processed image data and the scaling-proc- 
essed region segmentation data after the computing 
step, wherein in the outputting step, directing data, 10 
which represent a front and a rear of each line of plural 
picture elements on the output data and end of the 
image data, together with the scaling-processed image 
data and the scaling-processed region segmentation 
data. 15 

In other words, in the case where the scaling-proc- 
essed .image data are outputted to an external asyn- 
chronous image input/output device such as a facsimile 
and a personal computer, when the data, which repre- 
sent the front and rear of the line and the end of the 20 
image data, do not exist in the magnification varied 
region segmentation data, a number of picture elements 
of one.line and a total number of lines should be trans- 
mitted to other external asynchronous image input/out- 
put device. Moreover, even in. the case where this 25 
transmission is executed, a line counter should be 
always provided. 

However, in accordance with the above method, 
since the directing data, which represent the front and 
the rear of each line of a plurality of picture element on 30 
the output data and the end of the image data, are 
simultaneously outputted, a number of picture elements 
for one line and a total number of lines does not have to 
be transmitted to an external synchronous image 
input/output device. Furthermore, installation of a line 35 
counter can be avoided. 

An image processing apparatus of the present 
invention for scaling inputted image so as to output the 
scaling-processed image is characterized by having: 
region segmentation means for dividing the input image 40 
into blocks composed of a plurality of picture elements 
and detecting region segmentation data, which repre- 
sent possibilities of characters, photographs and mesh 
dots of a block of a target picture element per target pic- 
ture element; and computing means for computing den- 45 
sity of the target picture element on the output image by 
using an equation in which density of a plurality of adja- 
cent picture elements in the vicinity of the target picture 
element is inputted. 

wherein the computing means adjusts a weight so 
of the density of each adjacent picture element in the 
equation according to the region segmentation data of 
the target picture element. 

In accordance with the above arrangement, the 
region segmentation data, which represent the possibil- 55 
ities of characters, photographs and mesh dots on the 
image, are detected by the region segmentation means, 
and the interpolated picture element data per picture 
element are computed by the computing means accord- 
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ing to the equation in which the density of a plurality of 
adjacent picture elements in the vicinity of the target pic- 
ture element is inputted. At this time, a weight of the 
density of each adjacent picture element in the equation 
can be adjusted based upon the result detected by the 
region segmentation means. 

Therefore, the portion where the possibility of char- 
acters is strong is enlarged by the nearest neighbor 
interpolation or the like so that the edge of the enlarged 
characters can be prevented from becoming unclear. 
Meanwhile, the portion where the possibility of photo- 
graph is strong is enlarged by the interpolation of first 
through third degrees or the like so that a pseudo-con- 
tour is prevented from occurring on the enlarged photo- 
graph. 

As a result, even in the case where characters, pho- 
tographs and mesh dots coexist in an image read by a 
scanner, deterioration of image quality can be pre- 
vented by the variable scaling process according to the 
characters, photographs and mesh dots. 

For fuller understanding of the nature and advan- 
tages of the invention, reference should be made to the 
ensuing detailed description taken in conjunction with 
the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram which shows an arrange- 
ment of a digital copying machine as an image process- 
ing apparatus which adopts an image processing 
method according to one embodiment of the present 
invention. 

FIG. 2 is an explanatory drawing which explains an 
image processing function of the digital copying 
machine. 

FIG. 3 is an explanatory drawing which shows a 
computing process of a variable scaling section in the 
digital copying machine. 

FIG. 4 is a block diagram which shows an output 
control section and an image output section in the digital 
copying machine. 

FIGS. 5(a) through 5(c) are explanatory drawings 
which show output examples of a pulse width modulator 
on each picture element: FIG. 5(a) is a drawing which 
shows an output of the pulse width modulator in the 
case where half-tone data are outputted shifted to the 
(eft; FIG. 5(b) is a drawing which shows an output of the 
pulse width modulator in the case where half-tone data 
are outputted shifted to the right; and FIG. 5(c) is a 
drawing which shows an output of the pulse width mod- 
ulator in the case where half-tone data are outputted 
being centered. 

FIG. 6 is a graph which shows an original image 
having tone. 

FIG. 7 is a graph which shows density of read pic- 
ture elements when the original image shown in FIG. 6 
is read. 

FIG. 8 is a graph which shows an output in the case 
of using a nearest neighbor interpolation when the read 
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tone density and magnification of the variable scaling 
together, and setting the density D a to 0, whereas when 
the picture element density slope data are data repre- 
senting a relationship D b < D p < D a , converting the den- 
sity D a into a value obtained by multiplying the half-tone 
density and magnification together, and setting the den- 
sity Dp to 0. 

In the case where the read image is character data 
and picture elements in the read position is an edge of 
the character, the density of this picture element is 
mostly half-tone density. Then, when the image is sub- 
ject to the variable scaling process by the summing and 
multiplying operation in the equation (1), the half-tone 
density continues, and thus the edge becomes unclear. 

However, in accordance with the above method, 
when the density D a of the picture element A which is 
the closest to the picture element P is half-tone density 
(i.e., larger than 0 and smaller than the maximum den- 
sity) and the picture element density slope data S p of 
the picture element P are data representing a relation- 
ship D a < Dp < D b (positive), the density D p is converted 
into a value obtained by multiplying the half-tone density 
and magnification together and the density D a is set to 
0, whereas when the density D a is half-tone density and 
the picture element density slope data S p of the picture 
element P are data representing a relationship D b < D p 
< D a (negative), the density D a is converted into a value 
obtained by multiplying the half-tone density and magni- 
fication together, and the density D p is set to 0. 

Therefore, the density of two picture elements in the 
edge portion of the character data (pulse width for out- 
putting a laser) is subject to the variable scaling process 
so that the density of the picture element inside a, char- 
acter is varied according to magnification and the den- 
sity of the picture element outside the character 
becomes 0. As a result, the edge portion of the charac- 
ter data is further enhanced, and thus the edge portion 
of the characters can be prevented from becoming 
unclear. 

It is desirable that the image processing method 
further has: the step of outputting a laser according to 
density data with respect to the target picture element 
after the converting step, wherein in the laser outputting 
step, a laser is outputted to the target picture element, 
to which the value obtained by multiplying the half-tone 
density and the magnification of the various scaling 
together is given, in a position which is shifted to a side 
of the picture element where the density is higher based 
upon the picture element density slope data of the tar- 
get picture element. 

In other words, in the case where the read image is 
character data and the picture element in the read posi- 
tion is an edge of the image, when the picture element 
which was subject to the process of, for example, 8 
bits/picture element, has half-tone density, the picture 
element has the density of 128, i.e., 80H (H represents 
hexadecimal notation). Therefore, in an image output 
device which outputs a half-tone image by varying a 
pulse width of one picture element, the image data of 
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80H are generated in the central position of the picture 
element for half dot of one picture element. Then, in the 
case where the picture element, on which the image 
data for half dot are generated in its central position, is 
5 subject to the enlarging process, a white picture ele- 
ment of half dot appears between the picture element 
and an adjacent picture element. Such a white picture 
element continues per picture element, and thus a so- 
called ghost contour occurs. 
10 However, in accordance with the above method, a 
laser is outputted for a target picture element, to which 
the value obtained by multiplying the half-tone density 
and the magnification together is given, in a position 
which is shifted to a side of the picture element where 
75 the density is higher based upon the picture element 
density slope data of the target picture element. 

Therefore, when the picture element for the edge 
portion of the character data is subject to the variable 
magnification process according to magnification, via 
20 the image processing method, the ghost contour is pre- 
vented from occurring on the left or right of one picture 
element at the edge of the character data. 

It is desirable that the image processing method is 
a such a method that in the computing step, when the 
25 data of each interpolated picture element is computed 
by the computing means, the region segmentation data 
detected by the region segmentation means is variably 
scaled so as to be outputted together with the scaling- 
processed image data. 
30 In other words, in the case where the image data 
which was subject to variable scaling process are 
desired to be outputted into an external asynchronous 
image input/output device, such as a facsimile and a 
personal computer, together with the region segmenta- 
ls tion data, for example, if also the region segmentation 
data is not subject to the variable scaling process, a 
number of picture elements of the scaling-processed 
image data does not agree with that of the region seg- 
mentation data. For this reason, the region segmenta- 
te? tion data cannot be used. 

However, in accordance with the above method, the 
region segmentation data detected by the region seg- 
mentation means are also subject to the variable scal- 
ing process based upon the result detected by the 
45 region segmentation means so as to be outputted 
together with the scaling-processed image data. 

Therefore, a number of picture elements of the 
magnification varied image data can agree with that of 
the region segmentation data. As a result, in the case 
so also where these data are outputted to an external 
asynchronous image input/output device such as a fac- 
simile and a personal computer, the region segmenta- 
tion data can be used. 

ft is desirable that the variable scaling process for 
55 the region segmentation data in the computing step is 
performed based upon the result detected by the region 
segmentation means. 

As a result, since the data representing the possibil- 
ities of characters, photographs and mesh dots are 
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element in the equation is adjusted according to the 
region segmentation data of the target picture element. 

In other words, in the case where characters and 
photographs, etc. coexist in a document image, when 
the conventional nearest neighbor interpolation or the 5 
interpolation of first through third degrees is used for 
enlarging magnification, the following problems arise. 
Namely, when the nearest neighbor interpolation is 
selected, a pseudo-contour occurs on a photograph, 
and when the interpolation of first through third degrees 10 
is selected, an edge of characters becomes unclear. 

However, in accordance with the above method, 
region segmentation data, which represent possibilities 
of characters, photographs and mesh dots of a target 
picture element on an image are detected by the region 15 
segmentation means, and interpolated picture element 
data per picture element are computed by the comput- 
ing means according to the equation in which density of 
a plurality of adjacent picture elements in the vicinity of 
the target picture element is inputted. At this time, a 20 
weight of the density of each adjacent picture element in 
the equation is adjusted based upon the result detected 
by the region segmentation means. 

Therefore, a portion where the possibility of charac- 
ters is strong isjenlargecl^byjhe_nearest neighbor inter- 2s 
poiation or the like so that the edge of the enlarged 
characters can be prevented from becoming unclear. 
Meanwhile, a portion where the possibility of photo- 
graphs ,*s strong is enlarged by the interpolation of first 
through third degrees or the like so that the pseudo-con- 30 
tour can be prevented from occurring on the enlarged 
photograph. 

As a result, even if characters, photographs and the 
mesh dots coexist on an image read by a scanner, the 
image is scaled according to the characters, photo- 35 
graphs or mesh dots so that deterioration of image qual- 
ity can be prevented. 

It is desirable that the image processing method is 
such a method that in the detecting step, the region seg- 
mentation data are set so as to take a value X which 40 
falls the range of 0 to N-1 (N is an integral number not 
less than 2) and so that as the possibility of characters 
is stronger, the region segmentation data takes a 
smaller value and as the possibilities of photographs 
and mesh dots are stronger, the region segmentation 45 
data takes a larger value, and in the computing step, 
density Dp of a picture element P which is a target pic- 
ture element whose density should be determined, is 
computed according to the following equation: 

50 • 

J D p =(1-K)xD a + KxD b (1) 

(However, K = (X p /(N-1)) x (PA/(PA+PB)) ) 
where Xp is region segmentation data of the picture ele- 
ment P, D a is density of a picture element A which is the 55 
closest to the picture element P, D b is density of a pic- 
ture element B which is the second closest to the picture 
element P, PA is a distance between the picture element 
P and the picture element A, and PB is a distance 



between the picture element P and the picture element 
B. 

In other words, characters, photographs and mesh 
dots mostly coexist on an actual image, and when pat- 
tern matching or the like is used as a variable scaling 
method for a target picture element of such an image, a 
lot of memories are required for performing the variable 
scaling process delicately, and time required for the 
process is increased. 

However, in accordance with the above method, the 
computing means computes the density D p of the pic- 
ture element P according to the equation (1). In the 
equation (1), in the case where the region segmentation 
data X p obtain a value 0 representing complete charac- 
ters, for example. K =0 and D p = D a . Namely, this 
means the variable scaling process by the nearest 
neighbor interpolation. 

Meanwhile, in the case where the region segmenta- 
tion data Xp obtains a value N-1 representing complete 
photograph, for example, 

D p = (PB-D a + PA -D b )/(PA + PB) 

Therefore, D p becomes a linearly weighted mean of the 
density D a of the picture element A which is thexlosest 
to the picture element P and the density D b of the pic- 
ture element B which is the second closest to the picture 
element P. 

Therefore, even if characters, photographs and 
mesh dots coexist on an image, when the nearest 
neighbor interpolation or the like is used for a portion 
where the possibility of characters is strong and a 
method which is closer to the interpolation of first 
degree is used for a portion where the possibility of pho- 
tographs is strong at the time of performing the variable 
scaling process, a more suitable density of scaling- 
processed data can be obtained according by a simple 
summing and multiplying operation of the equation (1) 
based upon the region segmentation data which repre- 
sent the possibilities of characters, photographs and 
mesh dots detected by the region segmentation means. 
Namely, since density can be selected by outstanding 
software suitably for the characters, photographs and 
mesh dots per target picture element, density can be 
determined quickly and the deterioration of image qual- 
ity can be prevented by a simple arrangement of hard- 
ware. 

In addition, it is desirable that the image processing 
method further has: the step of obtaining picture ele- 
ment density slope data which represent density slope 
of the picture element P with respect to picture elements 
which are adjacent to the picture element P after the 
computing step; and the step of on the picture element 
P whose region segmentation data.Xp is 0 and whose 
density D p is half-tone density, and on the picture ele- 
ment A which is the closest to the picture element P, 
when the picture element density slope data are data 
representing a relationship D a < D p < converting the 
density D p into a value obtained by multiplying the half- 
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Description 

FIELD OF THE INVENTION 

The present invention relates to an image process- 
ing method and an image processing apparatus which 
are used for an image input/output device such as a dig- 
ital copying machine and reads an image and divides 
the read image into blocks composed of a plurality of 
picture elements so as to perform a variable scaling 
process on the image by interpolating or thinning out 
each picture element. 

BACKGROUND OF THE INVENTION 

Conventionally, in the case where a variable scaling 
of an input image is performed by a digital copying 
machine, namely, the input image is enlarged or 
reduced by a digital copying machine, it is enough to 
select either of a nearest neighbor interpolation and 
interpolations of first through third degrees per page. 

In the nearest neighbor interpolation, an image is 
divided into blocks composed of a plurality of picture 
elements, and when enlarging, the image, the data of 
the picture element existing in the nearest neighbor- 
hood of a target picture element is used as data of the 
target picture element. The enlarging method by means 
of the nearest neighbor interpolation has a preferable 
characteristic that an edge of a character becomes 
clear. 

In addition, in the interpolation of first through third 
degrees, data of a target picture element in divided 
blocks are determined by using an computing mean of 
the data of the nearest neighbor picture element of the 
target picture element and data. of another neighbor pic- 
ture element, which is obtained by formulas of the first 
through third orders so that an image is enlarged. This 
method is also called as a linear interpolation. More 
specifically, the data of the nearest neighbor picture ele- 
ment of the target picture element and the data of 
another neighbor picture element are respectively 
weighted with an inverse number of a distance from the 
target picture element and a weighted mean is 
obtained. The data obtained from the weighted means 
is specified as data of the target picture element. 

The enlarging method through the interpolations of 
first through third degrees is preferable as the enlarging 
process in the case of processing an image in which 
density gradually changes like a photographic image 
because new data of a picture element interpolated 
between the respective picture elements (interpolation 
picture element data) become means of picture element 
data existing on both sides adjacent. 

However, in the case where two or more types of 
image data, such as characters, photographs and mesh 
dots, coexist on one page of image, if a variable magni- 
fication of such an image is processed by either of the 
nearest neighbor interpolation and the interpolations of 
first through third degrees, image quality of either of the 



characters, the photographs, etc. is deteriorated. 

Therefore, Japanese Unexamined Patent Publica- 
tion No. 6-286221/1994 (Tokukaihei 6-286221) dis- 
closes a printing method which is capable of changing a 

5 variable scaling process according to types of data in 
the case where characters, photographs, mesh dots, 
etc. coexist on one page. 

In this printing method, input data such as character 
information such as character codes and form informa- 

io tion are inputted from a host as an external device into 
a buffer memory of a printer. The printer creates a char- 
acter pattern and a form pattern according to the infor- 
mation of the inputted data so as to print an image. 
In the case where enlarging or reducing process is 

15 executed prior to printing, when a special enlarging or 
reducing method is cataloged into the printer according 
to the character pattern, etc., variable scaling is per- 
formed by the enlarging or reducing process. Therefore, 
the variable scaling process can be performed accord- 

20 ing to each type of data. 

However, since the above conventional image 
processing method is applied to a printer, and the varia- 
ble scaling process of such a printer can be previously 
judged by information from an external host that charac- 

25 ters, vector drawings and bit images is inputted as 
image data. Therefore, in image input and output 
devices such as a copying machine, the above-men- 
tioned image processing method has a disadvantage 
that in the case where document image is read by a 

30 scanner and characters, photographs and mesh dots 
coexist.on one page of the read document image, a var- 
iable scaling process cannot be performed according to 
the type of image data. 

35 SUMMARY OF THE INVENTION 

The present invention is invented from a viewpoint 
of the above conventional problem, and it is an object of 
the present invention to provide an image processing 

40 method and an image processing apparatus which are 
capable of. even if characters, photographs and mesh 
dots coexist in an image read by a scanner, preventing 
a deterioration in image quality by variable scaling the 
image according to the characters, photographs and 

45 mesh dots. 

In order to achieve the above object, an image 
processing method of the present invention for scaling 
an image is characterized by having: the step of dividing 
an image into blocks composed of a plurality of picture 

so elements so as to detect region segmentation data, 
which represent possibilities of characters, photographs 
and mesh dots in a block of a target picture element, by 
region segmentation means per target picture element; 
and the step of computing density of the target picture 

55 element on the output image by using computing means 
according to an equation into which density of a plurality 
of adjacent picture elements in the vicinity of the target 
picture element is inputted, wherein in the computing 
step, a weight of the density of each adjacent picture 
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(54) Method an apparatus for image interpolation 

(57) In an image processing method, an image is 
read by an image processing apparatus such as a dig- 
ital copying machine and the read image is divided into 
blocks composed of a plurality of picture elements. 
Thereafter, interpolation is performed on a target picture 
element so that the image is scaled. Then, in the above 
image processing method, region segmentation data, 
which represent possibilities of characters, photographs 
and mesh dots of the target picture element of the 
image, are detected in a region segmentation section of 
the image processing apparatus, and the interpolated 
picture element data of the target picture element are 
computed by a variable scaling section according to an 
equation in which density of a plurality of adjacent pic- 
ture elements in the vicinity of the target picture element 
are inputted. At this time, a weights of the density of 
each adjacent picture element in the equation is 
adjusted based upon the result detected by the region 
segmentation means. As a result, even if characters, 
photographs and mesh dots coexist in an image read by 
a scanner, the image is scaled according to the charac- 
ters, photographs and mesh dots, thereby preventing 
deterioration in image quality. 
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